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Abstract Stochastic processes with multiphcative noise have been studied in- 
dependently in several different contexts over the past decades. We focus on the 
regime, found for a generic set of control parameters, in which stochastic processes 
with multiplicative noise produce intermittency of a special kind, characterized by 
a power law probability density distribution. We present a review of applications, 
highlight the common physical mechanism and summarize the main known results. 
The distribution and statistical properties of the duration of intermittent bursts are 
also characterized in details. 
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1 Introduction 



Consider the number of fish Xt in a lake in the t-th year. Let X^+i be related to the 
population Xt through 

Xt+i = aXt + b, (1) 

where a = a{t) > and b = b{t) > are drawn from some probability density function 
(pdf). The growth rate a depends on the rate of reproduction and the depletion rate 
due to fishing or predation, as well as on environmental conditions, and is therefore 
a variable quantity. The quantity b describes the input due to restocking from an 
external source such as a fish hatchery in artificial cases, or from migration from 
adjoining reservoirs in natural cases; b can but need not be constant. At first sight, 
it seems that the linear model (0) is so simple that it does not deserve a careful 
theoretical investigation. However it turns out that this is not the case : see, for 
example, a rather complicated mathematical analysis of the problem in |T[]. It turns 
out that model (P exhibits an unusual type of intermittency with a power law pdf 
of the variable Xt, for a large range of pdf's for a and b. As we show, the non- 
trivial properties of this simple model (|l]) come from the competition between the 
multiplicative and additive terms. 

If 6 = then (|ID describes a simple multiplicative process with a distribution 
which is log-normal in its central part. If a = 0, then Xt = b. If {a{t),b{t)) are the 
positive constants (a, 6), then Xt converges in the limit of large t to the attractor 
at the stable fixed point for a < 1 and diverges if a > 1. In the continuum 
limit of large t, assuming differentiability, the difference equation becomes a first 
order differential equation whose solution is X{t) = + Ce^^~^^^. The convergence 
(divergence) to (from) the fixed point is exponential with the rate (a — 1)^^ per unit 
time. 

In the case of divergence, limits on growth have often been introduced through the 
mechanism of nonlinear saturation, in the absence of external restocking. Probably 
the most studied case of such nonlinearity is the logistic equation p, which exhibits 
a panoply of dynamical behavior that ranges from bifurcations via a period doubling 
sequence, to deterministic chaos, among other properties, as well as certain universal 
properties However, because of the saturation, the nonlinear dynamics is not able 
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to simulate the observations of self-similar behavior that extend to large values of the 
variable X{t). 

Although the model (0) appears to be an apparently innocuous AR(1) (autore- 
gressive of order 1) process, the random and positive multiplicative coefficient a lead 
to non-trivial intermittent behavior for a large class of distributions for a. Standard 
stochastic population models P] are often described by (P with fixed coefficients. 
The intermittency arises because of the multiplicative noise structure, taken together 
with the additive source, and are not a property of usual AR processes with fixed 
coefficients 0. Earlier investigations of auto-regressive models with random coeffi- 
cients 1^ have focused on values of the parameters wherein Xt exhibits a stationary 
variance, and thus exclude the highly intermittent regime we describe here which is 
characterized by power law distributions with finite and infinite variance. 

The formal solution of (|l|) for t > 1 can be obtained explicitly 

N-l N-l N-l 

Xt = il[ail))Xo+Y.bil) n «M . (2) 

1=0 1=0 m=l+l 

where, to deal with / = — 1, we define nm=7v o-i'm-) = 1- Because of the successive 
multiplicative operations on a in the iteration of Xt, it is the average logarithmic 
growth rate (log a) that controls whether the population grows or dies. If the average 
logarithmic growth rate (log a) is negative due to overfishing and other environmental 
infiuences (in the example), then the population must ultimately disappear if there 
is no restocking through the b term. On the other hand, Xt diverges with increasing 
time if (log a) > 0. Thus, the process decays or grows depending on whether the 
rate = (log a) is negative or positive. In the case of decay, the introduction of 
new stock b has a persistent infiuence on Xt over the correlation time |tc|- In absence 
of nonlinear saturation mechanisms, we consider first the regime where (log a) is 
negative. From (2), it is clear that the Lyapunov exponent is nothing but (log a). 
Since most of the interesting regime occurs for negative (log a) , this would give again 
the impression of a trivial behavior, if the additive term was not present. 

Model (|I]) has similarities with the on-off intermittency described in . In partic- 
ular, the addition of additive noise on top of the multiplicative random forcing of the 
bifurcation parameter can be described by a biased random walk repelled from the 
origin in both problems The same mechanism of intermittent multiplicative 
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amplifications applies to both problems. However, the main difference is that the 
nonlinear saturation in the models studied in |^ prevents the appearence of large 
excursions and the power law tail does not exist. Most of the analysis of on-off in- 
termittency has been devoted to the unstable regime, corresponding in our notations 
to (log a) > 0, and to the calculation of the distribution of probability for a laminar 
phase of a given length. In contrast, we stress that model (|l]) has its most interesting 
regime for the "stable" case (logo) < and we discuss the pdf of the variable itself. 

Ref.(0) presents figures of typical evolutionary sequence Xt for the uniform dis- 
tributions 0.48 < a < 1.48 and < 6 < 1. In this case (log a) = -0.06747 and 
(a) = 0.98. For these parameters, {Xt) = = 25. Most of the time, Xt is sig- 

nificantly less than its average, while rare intermittent bursts propel it to very large 
values. Qualitatively, this behavior arises because of the occurrence of sequences of 
successive individual values of a that are larger than 1 which, although rare, are 
always bound to occur in this random process. The persistence of the temporal 
behavior has a decay which is exp[(log a)r] on the average, with correlation time 
1/1 (log a) I = 14.8 of the influence of restocking by the amount b(t — r) at a time r in 
the past on the present value Xt. The distribution of Xt from a numerical realization 
with the properties above gives an histogram characterized by a power law tail 

P{X) ~ X-(^+'^) , (3) 

and a rolloff at smaller values of Xt, which is a result that is mandated by the fact 
that as X{t) the process is dominated by the injection of new stock < 6 < 1, 
so that the population is repelled from a zero value. 

In the next section, we discuss a series of applications such as population dynamics 
with external sources, epidemics where we provide a rationalization for observed 
power law data, finance and insurance, immigration and investment portfolios where 
we generalize (|l]) to expanding processes, and the internet. In section 3, we review 
and synthesize useful results. First, we recall a generalization of equation ([1|) to 
general contractive maps with intermittent bursts with a repulsion from the origin. 
We then explain how the power law pdf can be calculated. We connect these processes 
to auto-catalytic equations that were found to also exhibit a power law pdf (for the 
same reason), but whose treatment using the Fokker-Planck formalism was limited to 
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gaussian (multiplicative) noise. We briefly mention log-periodicity that was recently 
found as corrections to the leading power law pdf. We exhibit the relationship with 
intermittency in nonlinear dynamical system and discuss the multiaffine structure 
of the corresponding time series. We end this section by reviewing and extending 
known results on the durations of the intermittent bursts and their distribution. We 
also summarize our knowledge on the extremes of the random variable Xt. Section 

4 proposes a nonlinear extension to the process (|l]) that includes the optimization of 
the restocking term b to develop an optimal strategy for population control. Section 

5 concludes. 

2 Domains of application 

2.1 Population dynamics with external sources 

Equation (||) is the simplest discrete map with external source one can think of. 
Notwithstanding the simplicity of its formulation, it exhibits a rich phenomenology, 
suitable to apply to population dynamics. Beyond the example of the fish population 
with restocking, agriculture provides another example, in which one wishes to model 
the annual fluctuations of the size of a crop in the case where, on average, the crop 
that is harvested leaves a seed crop residue that is less than that needed to fully 
reseed for the following year; in this case the variable b represents the seed purchased 
or otherwise obtained from outside sources. 

Similarly, the large biological variability of phytoplankton blooms in shallow 
coastal ecosystems, such as estuaries, lagoons, bays and tidal rivers, can also be 
explained by a population budget given by equation (|^) [T^ where a accounts for the 
difference between growth rate and loss rate to respiration, to pelagic and benthic 
grazing, and to exchanges of biomass vertically between the top of the sediments and 
the overlying water column and horizontally due to advective and diffusion transport; 
the b term models the effects of injection of new individuals across the boundaries of 
a given ecosystem. 

The results for (|I]) might explain the spontaneous large variability of such systems 
that are observed. Among still other problems, it would be interesting to explore 
whether the variability of long term geophysical time series, such as river discharge or 
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rainfall, which have been proposed in to be self-affine (see (pOD), can be framed in 



these simple terms or within their multi-dimensional generalizations described below. 

In population dynamics, empirical observations show that adjacent generations 
tend to be less different than distant ones, a problem that has plagued standard 
nonlinear dynamical models |T^, |T^|. Models and do not share this difficulty 



and agree with this empirical fact. This suggests that intermittent multiplicative 
noise might be a useful ingredient for future modelling of biological populations. 

2.2 Epidemics 

The number 5* of new cases of people infected with measles in isolated islands in the 
North Atlantic per epidemic event is observed to have a power law distribution with 
exponent about 0.3 (called (3 in [1^) : 

P{S)dS ~ dS . (4) 

The durations of epidemic events also have a power law distribution P{t) with an 
exponent 7 ~ 0.8. Equation (|l]) is a simple model of multiplicative growth that 
accounts for the observation of the power law distributions. The multiplicative term 
in (0) represents the spread though personal infectious contact and the additive term 
is representative of the introduction of new strains by agents from outside. Using 
this insight, we can predict 7 = 1 from the following self-consistent argument. 

Let Xt be the number of new cases between t — 1 and t in ([l|) which is distributed 
according to a power law distribution P{X) ~ as given in (^) and (^21) , 

with exponent /x. Notice that /i is a priori different from (3 a.s fi describes the pdf of 
fluctuations within an epidemic event while f3 describes the pdf of the total size of 
that event. The total number of cases in an epidemic event of duration r is 

Sr = j:X,. (5) 


For /i < 1, we find 

Sr ~ T^^" . (6) 

From the conservation of probability under a change of variable, we get 

P{T)dT ~ r-(^+'^/^) dr , (7) 
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I.e. 

7 = - • (8) 

In section 3.8 below, eq.(^TD finds, from a random walk argument, that 7 = 1/2 in 
the uncorrelated case. If we include correlations by an argument of self-similarity of 
epidemics within epidemics, i.e. the burst of new cases within a given epidemic event 
is a small epidemic event in itself (we define an epidemic event to be the sudden 
awakening from a relatively dormant state), we get (3 = fi and thus 7 = 1. This 
seems consistent with the observation 7 ^ 0.8 within statistical estimates of the error 
in the exponent in power law distributions 

2.3 Finance and insurance applications with relation to 
ARCH(l) process 

The relation between ([I|) and finance has been pointed out in several papers (see 
for instance |[TB|. Suppose you invest b{t) at time 0,1,2,... in a bond with interest 
time-dependent interest rate r^. The accumulated value Xf at time t of the interest 
payments made at times 0,..., t, assuming Yq = 1 is given by the equation 

Xt+i = b{t)+rtXt . (9) 

The inverse problem to accumulation is discounting. Suppose payments h{i) are made 
at times 0, 1, 2, .... Given the interest rate rj between time i and i + 1, the discounted 
value at time of all those payments made till time t is 

6()0 + 6(l)(l + ri_i)-i + 6(2)(l+ri_i)~'(l + rt-2)-' + ... + Ki)(l + rt-i)-^..(l + ro)-' • 

This has exactly the same form as (^ and obeys the same equation. 

The stochastic difference equation (|I|) is also obtained from the ARCH(l) 
(autoregressive-conditionally-heteroscedastic) models of log-returns : 



Rt+i = ^Jb + aR^ Zt , (10) 

where Zf is a gaussian random variable of zero mean and unit variance. This process 
([T0|) describes a persistence and thus clustering of volatilities R^. Indeed, the factor 
(6 + aRf)^ ensures that the amplitude of the motion Rt+i is controlled by the past 
realization of the amplitude R^. Now, calling Xt = {Rt), where the average is carried 



out over the realization of Z^, it is clear that ([10|) is equivalent to (P, if we allow the 
coefficient a and h to depend on time (independently from Zt). 

In the context of insurance, Xt can be interpreted as the value of a perpetuity: 
the payments h{t) are made at the beginning of each period and the accumulated 
payments Xt-i are subject to interest. The name perpetuity comes from "perpetual 
payment streams". See lll^ for an introduction to perpetuities from a life insurance 



point of view and [18 from a pension fond point of view. 



2.4 Immigration and investment portfolios 
2.4.1 Expanding regime 

Consider the case (log a) > and define 

r = /imi^oo^(log&) . (11) 

If r = 0, the additive term h becomes unimportant since Xt now diverges asymp- 
totically and the process becomes purely multiplicative. We restrict our attention to 
the case where r is strictly positive. If (log a) > r, Xt diverges exponentially with 
log-normal fiuctuations, since again Xt becomes asymptotically the result of a purely 
multiplicative process. A novel regime occurs when (log a) < r. In this case, let 

h{t) = e''^'+%{t) , (12) 

where b{t) is a stochastic variable of order one. Let 

a{t) = a{t) . (13) 

Since r > (log a), then (logd) < 0. Finally let 

Xt = e^'Xt . (14) 

Equation (|l]) is then transformed into 

Xt+i =aXt + b, (15) 

where a and b obey the conditions of our previous analysis exactly. Thus Xt has a 
well-defined asymptotic non-singular pdf with a power law tail for large values. 
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The sequence Xt is not stationary since it blows up exponentially at the average 
rate r. But for a given t, one can characterize fully the local distribution of X over a 
small time interval from the asymptotic pdf of Xf Around the average exponential 
growth at rate r, Xt exhibits large fluctuations. Locally in time, the distribution of 
Xt is of the form 

P{Xt) ~ e^^'-'X^^^^^^ , (16) 

where is a solution of 

{a>') = e'" . (17) 

The simulation shown in Figure 3 shows an average exponential growth with super- 
imposed fluctuations, much as in the case of Fig. 1. 

There is a parallel situation to that considered above if (log a) > with the 
constraint that Xf be smaller than some threshold X^ > 0. The pdf of Xt is then 
proportional to for < Xt < Xc, with fi given by equation (7) as before. This 

problem is the same as that studied by Grinstein et al. []Ty[ for higher dimensional 
versions of the model. 

2.4.2 Growth of immigrant populations 

As an example of exponential growth, consider the problem of the growth of immi- 
grant populations. Assume that the immigration flow b is increasing at a rate r. The 
national population may or may not grow exponentially with an average rate (log a) 
which can be negative (as for Germany in the last quarter of century) or positive but 
with a growth rate smaller than that of the immigrant population. This condition 
holds in general for several occidental countries that are magnets for immigration 
from the developing countries. For example, the increased rate of flow b might be due 
to an average growth rate of population outside the country which is larger than the 
growth rate within the country itself, although we do not have to restrict ourselves to 
this case. From the analysis above, we conclude that, due to the influx of immigrants 
from poorer countries with rapidly growing populations, the growth rate of the host 
country ultimately approaches that of the poorer countries that are the sources of the 
influx. Our model predicts self-similar fluctuations of the host-country population 
around the average growth rate, due to the interplay between the natural fluctuations 
of the intrinsic growth rate of the host country and the immigrant flux. This model 
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assumes that immigrants will abandon the fertility rate they had previously and ad- 
just it to that of the host country, on a time scale of the fluctuations of the intrinsic 
growth rate Q We have not tested these predictions for countries that have had a 
significant influx of immigrants. The simple model is not expected to account for 
all growth histories but it might help to distinguish between different causes for the 
growth of population. We note also that economics Nobel laureate Simon had similar 



ideas to explain the growth laws for cities |20 
2.4.3 Growth of investment porfolios 



Consider the growth of a portfolio of investments |^ such as that of a mutual 
fund. Consider a successful fund that exhibits a higher than market average return. 
Investors are thereby attracted to it and may invest new capital at a rate faster than 
the return rate itself. Not infrequently, new capital may flow in, even in the presence 
of relatively poor performance [|. Thus the condition (log a) < ^(logfe) holds. 
The growth of the fund thus occurs not only through reinvestment of returns, but 
also through periodic additions under an investment plan. Due to the stochastic 
character of returns, the fund will show regular exponential growth, upon which is 
superimposed a series of spurts and gradual decays back to the exponential growth 
the fluctuations are distributed according to a power law. We have assumed that 
mutual funds are bought and sold as net asset value and their liquidity is linked with 
their growth. Since liquidity is commonly observed to be correlated with the volume 
of transactions, which is itself correlated with price volatility ||23|, these considerations 
might also be relevant to explain fat tails for price variation pdf's [|^, |25[| . 

Equation (0) may also describe the evolution of composite capital growth on the 
large scale of an economy [Q, where {a = 1+ return — consumption} and b is 
the addition of new wealth from technological innovations or discoveries of mineral 
resources. 



*Indeed, at the next time step, the immigrant term b becomes part of the total population X 
which is updated with the (reduced) national growth rate a. 

^This is a zeroth-order approximation since it can be expected that correlations exist between 
the return of a fund and the confidence of the investors. 
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2.5 The internet 



There are probably many other areas where apphcation of these ideas may prove to 



be fruitfuL A recent paper by Huberman and Lukose |23] considers a multiphcative 
process to describe the population of users of the internet which cooperate. The model 
predicts intermittent congestions with short-lived spikes but lacks a random source of 
incoming users (the b term) which leads them to predict a log-normal distribution for 
Internet latenties. The reported data seems to exhibit a tail fatter than lognormal 
(see their figure 3), which we are tempted to interpret as the consequence of the 
multiplicative process, with intermittent amplification, coupled to a random additive 



source. In fact, Takayasu et al. have found a power law pdf for the frequency of 
jams in Internet traffics. 



3 Statistical properties 
3.1 Generalization 

Eq.(|]) defines a stationary process if (ln6(t)) < 0. In order to get a power law 
pdf, a{t) must sometimes take values larger than one, corresponding to intermittent 
amplifications. This is not enough : the presence of the additive term b{t) (which 
can be constant or stochastic) is needed to ensure a "reinjection" to finite values, 
susceptible to the intermittent amplifications. It was thus shown that (0) is only 
one among many convergent ((ln6(t)) < 0) multiplicative processes with repulsion 
from the origin (due to the b{t) term in (|l|)) : 

Xt+i = e^(^-{-''''-» a Xt . (18) 

/ has the following properties : 

/(Xi,{a,6,...})^0 forX.^oo, (19) 
i.e. Xt is a pure multiplicative process when it is large, 

/(Xi,{a,6,...}))^oo forXi^O, (20) 

i.e. Xt is repelled from 0. Additional conditions of monotonicity and regularity must 
be added to ensure that the pdf of Xt is unbound at large Xt- 
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All these processes share the same power law tail for their pdf P{x) ~ x^^^^ for 
large x with /i solution of (a(t)^) = 1. Inx(t) undergoes a random walk with drift to 
the left which is repelled from — oo. A simple Boltzmann argument shows that the 
stationary concentration profile is exponential, leading to the power law pdf in the 
x{t) variable. 

The deterministic version of equation ([l8|) has been discussed frequently in the 
biological hterature (see and references therein). The model (|l|) is the special 
case f{Xt,{a{t),b{t),...}) = log(l + ^^^^)- Thus the dynamics of Xt is the result 
of a multiplicative process that contracts on average. However the restocking term 
b prevents Xt from approaching zero by repulsion from the origin, and allows the 
distribution to converge to a non-trivial asymptotic pdf that turns out to be a power 
law under some mild assumptions stated below. In other words, the restocking term 
b which is a repulsion from the origin, corresponds to a resetting of the dynamics 
away from Xf = 0. The multiplicative process, with an a that can sometimes have 
values that are larger than 1, ensures an intermittent sensitive dependence on prior 
values of Xf. It is noteworthy that these ingredients of sensitive dependence on prior 
conditions and reinjection (of new stock), are also the two fundamental properties of 
systems that exhibit chaotic behavior p9| . 



3.2 Power law probability density function 

Qualitatively, the existence of a limiting distribution for Xt that obeys (p!8|), for a 
large class of f{X, {a, b, ...}) as in ([T9| , ^0|) , is guaranteed by the competition between 



the convergence of X to zero and the sharp repulsion from it. Kesten's result for 
model (|I]) proves only the existence of a power law tail for the pdf but gives no 
information about the central part of the pdf, which is assumed at least to be an 
integral function. The most general mathematical results for this class of models 
are valid only for linear systems (^ and under a number of assumptions about the 
random coefficients 

In the case of the generalized model, we can also give only a result for the tail of 
the pdf. With the additional condition df{X, {a, b, ...})/dx — > for X ^ cxd, which 



is satisfied for a large subclass of smooth functions that satisfy conditions ([T9| , |20|) 
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the pdf of X is the solution of 

pd/(^Xe-^(^'^^''->)) = pdf[aX^ . (21) 



The expression ( PT| ) means that the l.h.s. and r.h.s. have the same distribution. The 
solution to this problem has been given in P] as a solution to a Wiener-Hopf equation 
for the tail. All the models ([TsD are characterized by a pdf with a tail that decays 
asymptotically for large X as a power law 

P{X) ~ X-(^+^) , (22) 

if there is a solution > of the equation 

(aO = 1 . (23) 



It has been shown in |^ that the exponent /i does not depend on the realizations 
of h if the distribution of a is smooth, and more generally, on the specific form of the 
repulsion from zero. For the example shown in the figures, the numerical solution to 
(|23| ) ifi ji ^ 1.467. The pdf P{X) is always integrable at X — > oo because /x > 0. 
Its integrability for small X is ensured automatically if h is bounded from below for 
6 > and can be shown to be true even when the pdf of h extends down to zero, 
provided it is not too singular at 0. 

The result (p^) with property ( p3D was proved first for model (|l]) by Kesten |l|]. 



and was then revisited by several authors in the differing contexts of finance [24 



and ID random-field Ising models |^1|. Recently, Levy, Solomon and Ram have 



rederived this result for a different submodel of the class (|T8|) by the use of the 
extremal properties of the G—Ziarmonzc functions on non-compact groups |3^, which 
are translational groups in this paper. In a mapping to a biased random walk 



recovers these results. In the method of characteristic functions has been used 

to recover the power law for the regime of infinite variance corresponding to yU < 2. 

As a consequence of the relatively short-range correlations of Xt and the properties 

of linear combinations of variables with power law pdf tails, the pdf of the variations 

(Xf+i — Xt), and of higher order differences as well, also have a tail of the form (27) 

with the same exponent /i. 

•l-In general, when there is a real positive solution, there are also an infinitely discrete number of 
complex solutions (see below for their interpretation). 
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In the limit of small disorder on the multiplicative noise ((loga)^) — (loga)^ <^ 1, 
we can solve ( pS] ) by an expansion in (a^^) to second order in the cumulants of the 
pdf of a and get the approximation 

n ^ l<^"g")l (24) 

^ ((loga)2)-(loga)2 • ^ ^ 

This approximation is accurate for narrow pdf's and is exact if the pdf of log a is 
gaussian. For the case of the uniform distribution of the example, the estimate (|2^ ) 
is ~ 1.359, which differs from the exact value 1.467 by about 7%. 

3.3 Relation with auto-catalytic stochastic ODE 

In the context of auto-catalytic equations that lead to multiplicative stochastic equa- 
tions, Graham and Schenzle have determined the exact asymptotic pdf for the 



variable X obeying the equation 

— = -rX + pX^-P + 7]X , (25) 

where r is the decay rate in the absence of the last two terms and is a multiplicative 
Gaussian noise with zero mean. If p > 0, then X^~^ is negligible for large X compared 
to rX but dominates as X — 0. This terms plays exactly the same role as the 
function / in the discrete equation (|18D by guaranteeing repulsion from X = 0. It is 
clear that a discretization of ( ]25|) yields (|1^) with a{t) = 1 — r + ri{t) |. In the case 
of Gaussian noise which is the only one that has been studied thus far, expression 
( P^ ) is recovered, and the exponent is found again to be completely independent of 
the specifics of the repulsion from the origin, which is parameterized by the exponent 
p > [] in this case. It is of interest to note that the discrete systems (|l]) and ([T8| ) 
with non-Gaussian noise lead to pdf's belonging to a different universality class than 
in the case of Gaussian noise, i.e. these systems will have different exponents for the 
same average and variance of the multiplicative noise. This property is due to the 
importance of rare large deviations on the determination of the exponent /i. 

§Care must be taken to choose the correct representation (Ito or Stratonovich) and use the 
differential calculus accordingly in going from the discrete to the continuous description Q . 

^For p < 0, the repulsion is from infinity rather that from zero, and the dynamics is completely 
different. 
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3.4 Generalization to multi-dimensional processes 



For completeness, there is a recent generalization of eq.(|25D to multidimensional sys- 
tems [|19|, 13, 

dX d'^X 

where X{x, t) is now a field in a (i— dimensional space x and D is a diffusion coefficient. 
Qualitatively, this equation describes a c?— continuous infinity of variables X, each of 
which follows a multiplicative stochastic dynamics having the forms ( p^Sf ) or (^Sf), and 



in the discretized equivalent is coupled to nearest neighbors through a diffusion term. 
The problems (|25| ) and (|1^) correspond to the zero-dimensional case. Grinstein et 
al. [|I^ have studied the case p < in an arbitrary number of dimensions, which 
leads to a repulsion from -|-oo. Thus this case cannot lead to a pdf with a long tail 



and instead must belong to a completely different regime. Munoz and Hwa have 
considered the case p > which is relevant to our discussion, and also find a power 
law decay for the pdf of X. However, the determination of the exponent is done by 
numerical simulations and there are no exact results available for d > 0. 

3.5 Complex exponents and log-periodicity 



For a's with not-too-wide pdf 's, complex solutions of (|23D for the exponent n can also 
be found. Complex values of fi lead to log-periodic oscillations that are superimposed 
on the lowest-order behavior which is power law ||38|, ^], as can be seen in the tail of 



figure 2. The underlying discrete scale invariance has recently been found to be a 
widespread property of irreversible out-of-equilibrium processes Q . This 

log-periodicity overlaying the leading power law behavior of the probability density 
distribution is studied in details in with emphasis on the progressive smoothing of 



the log-periodic structures as the randomness increases in order to test its robustness. 
It is shown that the log-periodicity is due to the intermittent amplifying multiplicative 
events. 
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3.6 Relation with intermittency in nonlinear dynamical sys- 
tems 



These results should not give the impression that we have a complete understand- 
ing of the systems (|l]) or ([l8l). The results we have catalogued only describe the 
asymptotic tail for large X in the infinite time limit. The problem of the rate of 
convergence is much more involved and has only been addressed for eq. (^5]) in 
the case of Gaussian noise |35|. Furthermore, the apparent simple linearity of (|l|) 
masks equivalent nonlinear properties that are non-trivial. As mentioned, these sys- 
tems have an intermittent sensitivity to both the prior values of X and the reinjec- 
tion mechanism. The analogy with deterministic dynamical systems is even closer. 
Suppose that a is not truly stochastic but is itself generated by a deterministic dy- 
namical equation, say a{t) = e + r^, the latter given by the familiar logistic map 
rj_|_i = 4rt(l — Tf). The logistic map is well-known to be fully chaotic and has a 
invariant measure P(r) = ^[r(l — r)]^^/^. For positive but not too large e, a obeys 
the condition (log a) < while occasional individual realizations are larger than 1. 
Thus the fully deterministic coupled system, 

Xt+i = {e + rt)Xt + b , (27) 

n+i = An{l - rt) , (28) 

has the properties summarized above. We obtain the example exactly, if we replace 
(12) by the tent map 

n+i = 2rt mod{2) , (29) 

which is equivalent to (|28|) under a change of variable and has a uniform invariant 
measure in the interval < r < 1. The choice e = 0.48 gives the numerical example 
discussed in the introduction. The equivalence between the stochastic and deter- 



ministic chaotic processes for similar random walks has been checked in |^^. In our 
present problem, this result is correct as can be proved using the transition operator 
approach, which consists in describing the image of an arbitrary distribution density 
under the action of our random process. Ref . then proves that the representation 
of the transition operator depends only on the stationary probabilities of the random 
couples (a, 6), but not on the probabilities of the transitions between them, i.e. on 
the fact that the rt are correlated. 
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3.7 Self- affinity and mult iself- affinity 

The process Xt defined by (|I|) or (p^ is self-affine and can be characterized by its 



Hurst exponent H for 1 < < 2, through the expression |^ 

((Xi+A,-X,)')^~(At)^, (30) 

with 

1<H=-<1, (31) 
2 /i 

For the parameters of figure 1, H = 0.68. The relation (^) is vahd for At > \tc\. To 
see this, the typical largest value X^ax among At realizations of the variable Xf is 
given by 

At / P{X)dX ~ 1 , (32) 

which leads to 

X^„, -At^/^ . (33) 

The second moment ((Xt+At — ^t)'^) is then given by 

((X,+A* - X,f) ~ At f"^^^ X'P{X)dX ~ AtX^-^ ~ At'/^ . (34) 

Equation (^T)) follows. 

For a long sequence, the values X^ exhibit multi-self- affinity, as are log-normal 



distributions It is also possible to add a space dimension to the model by 

constructing multiaffine fields so that the field obeys eq. (Q) locally, and thus has 
all its properties. To do this, we use the construction given by Benzi, et al. 



with a mother wavelet basis function which is a constant over the unit interval; these 
operations will be developed further elsewhere. The above properties hold for infinite 
time sequences. In the practical case of samples of finite length, finite size effects 
round off the power tails: for Xt > e^^, (6) is approximately transformed into 



the log-normal law exp 



-^(logX.-yt) 



, where V = (log a). This result arises 



because these large values of Xt are in the "free" multiplicative regime and are remote 
from the influence of the repulsive, additive terms b that are important near X = 0. 

3.8 Extremes and durations of the intermittent bursts 

It is useful to characterize further the nature of the intermittent bursts. It is possible 
to quantify the distribution of extremely large bursts. In this goal, we adapt the 
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result given by 0] for ARCH(l) processes and translate it to the case of (|l|). We 
thus obtain 

limt^ooP(max{Xi,X2, < xt^/'^) = exp[-c^a;"^] , (35) 



(36) 



where the exponent is given by (PBI), the constant c is given by 

{{b + aXtr~{aXtr) 
fi{a>^lna) ' 

and ^ 

e = ^ Hp (maxt>i ff a(i) < -] y'^'^dy . (37) 

Ji \ - t=\ 

Expression ( ]35| ) shows that the stationary process (|T]) have similar extremal properties 
as a sequence of independent and identically distributed random variables with the 
same probability density function. In the mathematical literature on extremes pC 



6 is known as the "extremal index" . It quantifies the role of dependence between the 
successive Xt in the realization of extremal values. In particular, 6 < 1 implies a 
smaller achieved extreme compared to the case of iid random variables with the same 
powerlaw distribution. 

It is also possible to quantify the subset of times 1 < {te} < t a.t which Xt^ exceeds 
the threshold xti^ . In other words, among Xi, X2, Xt, some are above xt^*. What 
is the process describing these times of exceedance? It can be shown that this 
subset converges in distribution to a compound Poisson process with intensity c9x~^ 
and cluster probabilities 

vr. = , (38) 

where 

9k = fij^ P (^card t/ n a(i) > ^ = k - 1^ y^^^^'dy . (39) 



S 



stands for the cardinal of the set S, i.e. 



Note that = as defined by (|3^). card 
the number of elements in that set. 

Intuitively, the points of exceedance of a given threshold can be obtained in terms 
of the random walk Sq = 0, St = Z]i=ilna(i) ||50l (page 475). This is exact in the 



process studied in ||3^ defined by Xt+i = sup{a(t)Xt, 1}, which defines a multiplica- 
tive process that is reflected from the left boundary X = 1. This reflection ensures 
the repulsion from the origin described as the generic mechanism for the generation 
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of power law pdf's by convergent multiplicative processes. Taking the logarithm and 
defining Xt = InX^, InX^+i = supjlnX^ + lna(t),0} which defines a random walk 
with a bias to the left ((In a) < 0) and refiected at the origin. In between two succes- 
sive refiections, this is a pure random walk. The process is thus the union of pieces 
of biased random walks, all starting from the origin and returning to it for the first 
time. At each collision with the origin, the random walk looses the memory of past 
motion. This correspondence allows us to get the exact distribution of durations 
between return to the origin, i.e. the distribution of the peak durations. Notice that 
this distribution F{t, x) (which is the probability for the random walker to reach 
position X at time t, starting from the origin at time 0) also describes the width 
of a peak above an arbitrarily defined threshold, as the probability of return to the 
origin is independent of the definition of the origin. This distribution is a power law 

3 

~ t~2 truncated for large t by the presence of the negative drift v = (In a) which 
tends to bring back the random walk faster to the origin. The exact expression is 



obtained from the technique of generating functions |^ and reads (see |^2[ for an 
exact explicit relation and also |K 



F,(t, x) = (1 - e-""F,=o(t, x) , (40) 

where a is defined by cosh a = :^7j=f (leading to a ^ for t> ^ 0) and Fy=Q{t, x) is 
the probability of first passage at x starting from the origin at time 0, under no drift. 
The factor (1 — v"^)^ e~°^ thus embodies the effect of the bias v = (In a) < 0. 

The durations of intermittent amplifications are thus distributed according to 
Fy{t,0) giving the pdf of the first return to the origin, starting from the origin at 

3 

time 0. Since Fy=Q{t,0) ~ t~2, we get 

Fy{t, 0) ~ t"2 e — — * ^ r 5 e-- * , (41) 

where the last expression is valid for small drift. The same tail with a power law 
truncated by an exponential describes the other processes ([T8|). 

For the example of section 2, v = (In a) = —0.06747, leading to a characteristic 
time I in(i^^2) I ~ 440. The pdf of the durations of intermittent amplifications is thus 

3 

indistinguishable from the power law t~2 for durations less than 440 and crosses over 
to an exponential tail for large durations. Figure 1 shows a sequence which is clearly 
in the first power law regime for the duration pdf. 
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4 A non-linear extension : optimization of restock- 
ing strategy 



Up to now, the restocking term b{t) has been considered to be independent of X{t). 
As a first exercise, we now examine a case where b{t) becomes a function of X{t — 1) 
so as to optimize a restocking strategy. This problem is motivated by the observation 
that, whether we consider the general problems of game management or the specific 
example of fish restocking, large fluctuations in population size from year to year 
are to be expected. One could thus hope to cushion the fluctuations by exerting a 
control on b{t). In this spirit, variations of the model (|l|) have recently been proposed 
for the analysis of crop control in the presence of weed infestion in which the 
control of restocking is done on an action on the multiplicative term. Here, we analyze 
the restocking strategies defined by the action of b, where b can become a function 
of Xt that do not modify the power-law property of the tail, for a broad class of 
functions b{t, Xt) Q, if the growth rate a is unknown and fluctuating. Indeed, large 
scale fluctuations are a robust feature of the intermittent multiplicative process (|1|) 
which do not depend on the specific nature of the reinjection mechanism at small 
X{t). Optimized strategies b{t) can be defined, even in the absence of correlations in 
the time series a(t), if one knows the pdf Pa{ci). 

We refer to for an effort to model explicitly the dynamics of the fishermen 
behavior, coupled to the ecological and economic dynamics, which is partly based 
on neural nets. We also neglect nonlinear corrections between the annual number of 
offsprings and the size of the stock, which is important in absence of restocking 
but is of minor concern when (log a) < for which the restocking term is dominating 
the dynamics. 

Suppose we want to prevent the population Xt from decreasing below some min- 
imum Xmin, and that any restocking action has a price, which can be taken to be a 
constant (overhead) plus a term that is proportional to the amount of added game, 
to a first approximation. The mathematical solution of this problem demands the 

"We note that the hnear relation b = aXt does not preserve the power-law property since this 
yields the purely multiplicative process Xt+i — (a(t) + a)Xt. More generally, if b vanishes with Xt, 
the influence of restocking disappears for small X. It is the mechanism of repulsion from the origin 
induced by the b term that leads to the power law distribution. 
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definition of a cost function to be minimized. Many choices are possible and can 
be treated similarly. For the sake of illustration, let the cost function be propor- 
tional to the probability that Xf will be less than some X^in] if < ^mm we 
declare that the year will be lost for fishermen or hunters and hence also for the 
various suppliers of their equipment. In term of economic loss, our simple model 
assumes that the price of such an event is some aggregate loss multiplied by the 
probability that it occurs. The price of restocking must be added to the price of the 
event and the sum minimized, which corresponds to a trade-off. We thus minimize 
jx^^n p(^Xt+i\Xt,b{t))dXt+i + \b{t), with respect to b{t) to find the best restocking 
strategy. The quantity P{Xt+i\Xt, b(t)) is the pdf of Xt+i, given the population Xt 
of the previous year and assuming b{t) determined by the optimization. The factor 
A is a measure of the price of restocking relative to the loss experienced when the 
population is too small. From (|ID, P{Xt^i\Xt,b(t)) is simply deduced from Pa{a) by 
a change of variable. The solution of the minimization problem is 

^ = AX,. (42) 

This equation has a non-zero solution for b only if AX, is smaller than the maximum 
of Pa- If not, the solution is 6 = which corresponds to the situation where either 
the previous population X, was so large that next year is almost certain to be a 
good year without external action, or the price to restock A is too large. If AX, is 
smaller than the maximum of Pa, and Pa has a bell shape, there are two solutions 
to (0), but only the one which makes the least is the genuine minimum 

of the cost function, the other being a maximum. The specific optimal strategy for 
choosing b thus depends on the detailed shape of the pdf Pa'- this does not come as 
a surprise since the multiplicative process a is the dominant factor in the creation of 
stochasticity. We find, in agreement with intuition, that b is larger for smaller AX,. 
In general, 6 is a non-linear function of Xf. However, since it goes to zero for large 
Xf, we conclude that the fluctuations for large X, are not modified by the restocking 
strategy, which after all is only important for buffering the low values. 
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5 Concluding remarks 



We have reviewed the main know properties of intermittent multiphcative processes. 
We have shown that they provide a robust and general model of intermittent self- 
similar dynamical processes with power law pdf tails. Even in the complete absence 
of non-linearity, the population Xf exhibits a non-trivial intermittent dynamics for 
(log a) < ^(log6), whether b be determined deterministically or stochastically. If 
b is bounded or grows sub-exponentially, then i(log6) —>■ and the multiplicative 
process has to be convergent ((log a) < 0). The competition between the random 
multiplicative process a and the external source b is enough to produce intermittency 
as measured by the Hurst exponent and power law distributions. These results also 
hold for the more general class of models ([18|) . The power law distributions are the 
hallmark of convergent multiplicative processes repelled from the origin and do not 
need the fine tuning of a control parameter as in usual models of criticality ||57|| . 
The model (|I|) provides a simple useful alternative to self-organizing models with 
nonlinear interactions |^8|, |59|. We have however shown how these stochastic linear 
systems can appear to have the properties of a nonlinear dynamical system. 
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